Weighted Latent Dirichlet Allocation, an Optimized and Generalized Probabilistic Topic Model For Large Corpus of Data
By: Bhat, Muzafar Rasool
.
Contributor(s): Wani, M. Arif.
Publisher: New Delhi STM Journals 2018Edition: Vol, 5 (1), Jan-Apr.Description: 18-31p.Subject(s): Computer EngineeringOnline resources: Click Here
In:
Journal of artificial intelligence research and advances (JoAIRA)Summary: this study, we have introduced a new distribution named as Mixture Weighted Dirichlet Distribution (MWDD) which acts as generalization to other distributions viz. Dirichlet Distribution, Length or Size-Biased Dirichlet, Area Biased and Volume Biased Dirichlet distributions. Aim of this research is to introduce and implement MWDD for Probabilistic Topic Modeling of Corpus of textual data as an optimized as well as generalized probabilistic topic model. Various statistical and structural properties which include moments (1st, 2nd and rth) moment about origin, Variance and Standard deviation of the proposed distribution are thoroughly studied. Cora, a dataset of 2410 scientific documents in LDA format conforming to probabilistic topic modeling experimentations has been used in this study. Generative process of new probabilistic topic modeling technique using MWDD is also elaborated in this manuscript. For comparing the efficiency of existing as well as various special cases of the proposed model, AIC’s, AICC’s, BIC’s and log likelihood measures have been utilized. This study concludes that special case of the proposed model namely Mixture Volume Biased Weighted Dirichlet distribution (MVBWDD) is efficient as it has least AIC, AICC and BIC values with p, a mixture parameter varying from 0 to 1 on probabilistic topic modeling of the Dataset.
| Item type | Current location | Call number | Status | Date due | Barcode | Item holds |
|---|---|---|---|---|---|---|
Articles Abstract Database
|
School of Engineering & Technology Archieval Section | Not for loan | 2021-2021459 |
this study, we have introduced a new distribution named as Mixture Weighted Dirichlet Distribution (MWDD) which acts as generalization to other distributions viz. Dirichlet Distribution, Length or Size-Biased Dirichlet, Area Biased and Volume Biased Dirichlet distributions. Aim of this research is to introduce and implement MWDD for Probabilistic Topic Modeling of Corpus of textual data as an optimized as well as generalized probabilistic topic model. Various statistical and structural properties which include moments (1st, 2nd and rth) moment about origin, Variance and Standard deviation of the proposed distribution are thoroughly studied. Cora, a dataset of 2410 scientific documents in LDA format conforming to probabilistic topic modeling experimentations has been used in this study. Generative process of new probabilistic topic modeling technique using MWDD is also elaborated in this manuscript. For comparing the efficiency of existing as well as various special cases of the proposed model, AIC’s, AICC’s, BIC’s and log likelihood measures have been utilized. This study concludes that special case of the proposed model namely Mixture Volume Biased Weighted Dirichlet distribution (MVBWDD) is efficient as it has least AIC, AICC and BIC values with p, a mixture parameter varying from 0 to 1 on probabilistic topic modeling of the Dataset.
Click on an image to view it in the image viewer
There are no comments for this item.